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Abstract 


The  ellipsoid  method  is  applied  to  the  unconstrained  minimization  of 
a  general  convex  function.  The  method  converges  at  a  geometric  rate,  which 
depends  only  upon  the  dimension  of  the  space  but  not  on  the  actual  function. 
This  rate  can  be  improved  somewhat  if  the  function  satisfies  some  Lipschitz- 
type  condition,  or  if  the  minimum  set  has  dimension  greater  than  zero. 

If  the  ellipsoid  entirely  contains  the  optimal  set,  equating  the  Steiner 
polynomial  associated  to  the  optimal  set,  and  the  volume  of  the  ellipsoid 
at  a  given  iteration,  will  give  an  upper  bound  on  the  minimum  recorded 
function  value. 


Keywords ;  Ellipsoid  method,  nondif ferentiable  optimization,  convex 
programming,  volumes. 
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1.  Introduction 


The  ellipsoid  method  is  an  implementable  version  of  the  method  of 
centers  of  gravity  of  Levin  [13];  both  algorithms  are  designed  to  minimize 
a  general  convex  function. 

Levin's  method  is  a  natural  extension  to  general  convex  functions.  In 
n  dimensions,  of  the  bisection  algorithm  for  one  dimensional  unimodal 
functions.  It  can  also  be  viewed  as  a  cutting  plane  method,  where  the 
new  iterate  is  defined  as  the  center  of  gravity  of  the  set  formed  by  the 
intersection  of  all  previously  generated  cutting  planes;  a  new  cutting 
plane  is  generated  at  this  point,  and  added  to  the  list  of  cutting  planes. 

What  is  quite  remarkable  about  this  is  that  the  domain  of  localization 
of  the  solution  (i.e.,  the  intersection  of  the  previously  generated  hyper¬ 
planes)  has  its  volume  reduced  at  each  iteration  by  a  ratio  of  at  least 
1  -  (n/(n+l))n  <  1  -  1/e.  This  implies  that  the  minimum  recorded  function 
value  is  bounded  above  by  a  geometric  progression  of  ratio  (1  -  l/e)^n; 
this  result  is  not  quite  proved  in  Levin's  paper. 

The  ellipsoid  method  is  also  a  particular  version  of  a  class  of 
algorithms  due  to  Shor  [17,  18,  19,  20,  21]  which  can  be  described  as  a 
variable  metric  subgradient  optimization  method,  where  the  metric  is  updated 
at  every  iteration  by  a  rank  one  matrix.  The  variable  metric  was  introduced 
by  Shor  as  an  attempt  to  correct  the  bad  convergence  of  subgradient  optimiza¬ 
tion  on  convex  functions  with  very  elongated  level  sets  (or  badly  conditioned, 
acute,  very  kinky,  gully-type  functions).  Clearly  any  variable  metric  method 
can  be  interpreted  in  terms  of  an  ellipsoid.  The  method  worked  reasonably 
well  as  a  heuristic,  but  proofs  of  convergence  were  hard  to  come  by,  and 
quite  unsatisfactory. 


Yudin  and  Nemirovskii,  in  two  seminal  papers  [22,  23]  dealing  with 
the  computational  complexity  of  the  general  convex  programming  problem, 
did  (among  other  things)  combine  the  methods  of  Shor  and  Levin  in  what  is 


now  called  the  ellipsoid  method:  it  is  an  implementable  version  of  Levin's 
method,  and  also  a  version  of  Shor’s  method  for  which  a  proof  of  convergence 
exists.  In  restricting  oneself  to  ellipsoids  rather  than  using  general 
convex  sets,  the  volume  of  the  domain  of  localization  of  the  solution  is 
reduced  at  each  iteration,  by  the  ratio 

n  /_ni_/n‘1)/2  <  ~[l/2(n+l)]  . 

n+1  '  2  '  <  6 

n  -1 

this  implies  that  the  ellipsoid  method  would  take  approximately  2n/e 
times  the  number  of  iterations  that  Levin's  method  requires  to  reach  a 
given  accuracy.  Yudin  and  Nemirovskii  also  show  that  no  algorithm  (using 
the  information  given  by  an  oracle  which  returns  the  value  of  the  function 
and  a  subgradient  corresponding  to  each  iterate)  can  improve  significantly 
on  Levin's  method. 

The  results  given  by  Yudin  and  Nemirovskii  are  of  a  slightly  different 
nature  from  the  ones  given  in  this  paper;  they  look  for  a  minimum  of  a 
convex  function  subject  to  the  restrictions  that  the  point  belongs  to  a 
given  compact  convex  set  G  (with  an  interior)  and  that  if  satisfies  one 
convex  inequality  (or  any  finite  number  of  convex  inequalities) .  The 
presence  of  one  inequality  has  the  impact  that  the  algorithm  depends  upon 
the  precision  that  one  decides  to  reach  at  termination,  and  thus  no  rate 
of  convergence  can  be  given.  The  presence  of  the  set  G  (required  to  make 


2 


a  definition  of  computational  complexity  work)  is  handled  by  assuming  that 
an  explicit  projection  map  on  G  is  available,  thus  restricting  G  to  be 
a  simplex,  a  sphere,  a  rectangular  parallelotope ,  etc.  ....  but  not  an  ellipsoid 
(the  projection  on  an  ellipsoid  appears  to  require  the  solution  of  an 
eigenvalue-vector  problem);  the  algorithm  is  also  slightly  changed. 

For  the  problem  of  minimizing,  without  constraints,  a  general  convex 
function,  Shor  [20]  showed  that  convergence  is  bounded  by  the  product  of 
an  arithmetic  series  and  a  geometric  series. 

Khacian  [10,  11]  applied  the  results  of  Yudin  and  Nemirovskii  to  the 
linear  programming  problem,  or  to  the  problem  of  solving  a  system  of  linear 
inequalities.  Again  the  convergence  proof  is  based  upon  a  perturbation 
technique,  iad  no  rates  of  convergence  are  given. 

In  Section  2  of  this  paper,  it  is  first  shown  that  the  n^  root  of 
the  volume  of  the  intersection  of  the  level  sets  of  a  convex  function  with 
a  convex  set  is  a  concave  function  of  the  level.  This  implies,  using 
a  parametrized  version  of  the  proof  given  by  Yudin  and  Nemirovskii 
[22,  23],  Khacian  [10,  11],  Gacs  and  Lovasz  [8],  and  Aspvall  and  Stone  [2], 
that  convergence  is  finite  if  the  initial  ellipsoid  intersects  the  optimal 
set  Iii  a  set  of  dimension  n,  while  if  this  intersection  is  not  empty 

2 

convergence  occurs  at  a  geometric  rate  which  is  approximately  1  -  l/2n  . 

This  result  is  valid  for  any  convex  function,  and  is  independent  of  the 
particular  function.  In  Section  3,  an  attempt  is  made  at  showing  that 
the  rate  of  convergence  of  the  ellipsoid  method  may  depend  on  the  properties 
of  the  function  one  minimizes:  it  depends  both  on  some  Lipschitz-type 
characteristics  of  the  function,  and  on  the  dimensionality  of  the  intersection 
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of  the  initial  ellipsoid  with  the  optimal  set.  It  is  also  shown  that  a  bound  on 


the  value  of  the  function  reached  is, if  the  initial  ellipsoid  entirely 
contains  the  optimal  set,  given  by  an  equation  relating  the  Steiner  polynomial 
of  the  optimal  set  to  the  volume  of  the  ellipsoid,  at  a  given  iterate. 

Section  4  is  e.  sentially  an  appendix  containing  a  few  necessary 
technical  results  on  volumes.  It  is  based  upon  the  books  of  Bonnensen  and 
Fenchel  [3],  Busemann  [4],  Eggleston  [5],  and  Hadwiger  [9]. 


2.  A  general  convergence  theory 


The  ellipsoid  algorithm  will  be  used  to  solve  the  problem  of  minimizing 
a  general  convex  function  f  defined  on  Rn.  Let  9f(x)  be  the  subdifferential 
of  f  at  x,  f*  =  Inf{f(x)  :  x  €  Rn}  be  the  minimum  value  of  f,  and 
S*  =  {x  €  Rn  :  f  (x)  _<  f*}  =  {x  €  Rn  :  0  €  9f(x)}  be  the  set  of  minimal 
points.  It  will  be  assumed  throughout  (unless  otherwise  specified)  that 
f*  is  finite  and  that  S*  is  not  empty. 

Let  d(x,S)  denote  the  Euclidean  distance  between  a  point  x  and  a 
set  S,  i.e,  d(x,S)  =  Inf  { || x— y ||  :  y  €  S)  where  ||  •  ||  is  the  Euclidean 
norm;  d(x)  will  be  used  for  d(x,S*).  The  diameter  of  a  compact  set  S 
is  defined  by  D(S)  =  Sup{||x-y||  :  x  €  S,  y  6  S};  while  the  inradius  r(S) 
is  the  radius  of  a  largest  sphere  contained  in  S.  The  unit  closed  ball 
is  B  =  {x  6  Rn  :  ||x||  _<  1};  the  interior  of  B  is  denoted  by  B^.  The  set 
of  all  compact  nonempty  sets  in  Rn  is  metrized  by  the  Hausdorff  distance 

d(A1,A2)  =  Inf  { 6  ^  0  :  Ax  +  6B°  c  +  6B°  c  A^  ; 

convergence  and  continuity  are  defined  using  this  metric  (or  any  of  its 

topologically  equivalent  versions). 

The  volume  V[S]  of  a  bounded  measurable  set  S  in  Rn  is  its  n 

dimensional  Lebesgue  measure;  V [<f> 3  will  be  taken  as  -°°.  The  volume  of 

the  unit  ball  is  co  =  nn^/r(n/2  +  1).  The  surface  of  A  is  denoted  by 
n 

F(A).  If  A  is  a  s  dimensional  set  in  Rn,  then  Vg[A]  (and  Fg[A]) 
will  denote  the  volume  (and  the  surface)  of  A  within  the  s  dimensional 
affine  manifold  containing  A. 


(k) 

The  ellipsoid  algorithm  computes  a  sequence  { (x  ,  E^)  :  k  =  0,1,.. 
where  each  E^  is  an  ellipsoid  in  R°  and  x^^  is  its  center. 

Step  1 

Choose  a  point  x^  €  Rn  and  an  ellipsoid  Eq  c  Rn  centered  at 
x(0)  such  that  E^  fl  S*  is  not  empty  (i.e.,  Min{f(x)  :  x  €  E^}  =  f*). 

Step  2 

Compute  a^  €  df(x^). 

(k)  (k) 

If  a  =  0,  stop  with  x  optimal;  otherwise  go  to  Step  3. 

Step  3 

Let  «  {x  €  Rn  :  (a^,  x-x^)  0};  then  define  as  the 

least  volume  ellipsoid  cointaining  H  fl  E^,  and  take  x^+^^  as  the 
center  of  E^^.  Set  k  *-  k+1  and  go  to  Step  2. 

This  algorithm  is  implementable  as  the  ellipsoids  can  be  described 
by  matrices,  and  the  iteration  from  to  is  described  by  a  rank 

one  matrix  update  [2,  8,  10,  11,  17,  18,  19,  20,  21]. 

The  key  observation  is  that 

V[Ek+l]  =  cn  V[Ek]  and  thus  VtEk]  =  (cn)k  V[E0] 


with 


and  V[E^]  decreases  as  a  geometric  series  whose  ratio  depends  only  upon 
the  dimension  of  the  space. 

It  should  be  remarked  that  in  the  remainder  of  this  paper  the  fact 
that  the  sets  E^  are  ellipsoids  is  not  used  (at  least  not  much).  It 
follows  that  most  results  can  be  applied  to  Levin's  method  of  centers  of 
gravity  with  c^  =  1  -  (n/[n+l])n  <  1  -  1/e  replacing  cn;  the  method  is  a 
nonimplementable  version  of  the  ellipsoid  algorithm,  which  uses  general 
convex  sets  A^»  with  inStep  3  A^+^  =  fl  A^  and  is  defined 

as  the  center  of  gravity  of  A^+^  (one  has  V[A^+^]  V[A^] ,  [14]). 

Levin's  method  is  clearly  a  cutting  plane  method. 

It  is  an  open  question  whether  other  classes  of  convex  sets  (simplices, 
parrallelo topes ,  etc.,  ...)  would  provide  implementable  versions  of  this 
algorithm. 

Proofs  of  convergence  of  the  ellipsoid  algorithm  are  based  upon  a 
study  of  the  behavior  of  volumes.  Other  characteristics  of  convex  sets  may 
be  used,  for  instance  the  inradius  [11,  12],  as  clearly 


r(E.  )  <  (V[E,  ]/«  )1/n  =  (V[En]/«o  )1/n  (c  )k/n 
k  —  tc  n  U  n  n 


and  furthermore  r({x  €  Eg  :  f(x)  _<  a})  is  a  concave  function  of  a. 

Usually  the  starting  ellipsoid  Eg  will  be  taken  as  a  sphere  with 


center  xv  and  radius  r  (Er 


+  rB);  clearly  in  this  case 


Eg  H  S*  /  i  if  and  only  if  d(xv  )  r,  which  means  that  one  needs  an 
overestimate  of  the  distance  between  a  point  x^^  and  the  opitmal  set  S*. 
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The  general  theory  of  convergence  of  the  ellipsoid  method  will  be 


based  upon  the  properties  of  the  function 

h(E;  e0>  -  v|Tf,+t  n  e0) 

where  =  {x  (  Rn  :  f(x)  a}  are  the  level  sets  of  f  and  Eq  is 
the  starting  ellipsoid. 

If  the  optimal  set  S*  is  bounded  then  one  can  define  the  function 


h(e) 


V[T 


f*+e' 


Clearly 


h(e)  =  h  (s  ;  EQ)  for  all  t  €  [0,  £q(Eq)],  where 

e0(E0)  =  Sup{t  :  Tf*+£  c  EQ} 

=  Inf { f (x)  -  f*  :  x  i  Eq} 


Lemma  2.1: 

Let  f  be  a  convex  function  defined  on  Rn,  with  minimum  f*,  and 
minimum  set  S*,  and  E  be  a  compact  convex  set  such  that  E  0  S*  is  not 
empty,  then  the  function  h(e;  E)  =  V[TfA+£  H  E]  defined  for  t  £ 
has  the  following  properties: 

i)  It  is  continuous  on  t  €  [0,°°). 

ii)  It  is  strictly  increasing  for  e  £  [0,  e*(E)]  v’here  e*(E)  =  Max{f(x)- 
x  £  E>. 
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vanmnoB 


iii) 

h(e ;  E) 

iv) 

v) 

S  €  [0, 


=  V[E]  for  all  e  2  t*(E),  and  h (0;  E)  =  V[E  (1  S*]  . 
E)  Is  concave  for  e  f  (0,°°). 

E)  >  t/e*(E))  V1/n[E]  +  (1  -  y^y)  V1/n[E  n  S*]  for 
&*(E) ] . 


Proof  : 

i)  follows  from  the  continuity  of  TjA+r  fl  E  for  all  e  €  [0,°°) 

(by  Theorem  4.6)  and  the  continuity  of  the  volume  on  the  set  of  compact 
convex  sets  (by  Theorem  4.8). 

ii)  and  iii)  are  clear. 

iv)  follows  from  Lemma  4.4  and  Theorem  4.7. 
v)  h1//n(s;  E)  =  h1//n(-“^ry  e*(E)  +  (1  -  e*(~E))°;  e)  and  thus  v) 
follows  from  iii)  and  iv).  Q.E.D. 

The  function  h(s),  defined  only  if  S*  is  compact,  has  similar 
properties . 

Definition  2.2: 

The  functions  h  ''"(t;  E)  and  h  ^(t)  are  defined  as  the  inverses  of 
the  functions  h(e;  E^)  and  h(e),  or  more  precisely:  h  ^(t;  E)  is 
defined  for  t  €  [0,  V [ E ] ]  by 

h_1 (h (e ;  E) ;  E)  =  e  ,  for  e  €  [0,  c* (E) ] 

h-1  (t ;  E)  =  0  ,  for  t  €  [0,  V[E  (1  S*]]  ; 
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h  1(t)  is  defined  for  all  t  f  I0,«>)  by 

h  ^  (h  ( f  ) )  =  r.  for  t  £  [  0 ,°°) 

h_1(c)  =0  for  t  £  [0,  V[E  PI  S*]  ]  . 

Classical  properties  of  inverse  functions,  and  Lemma  2.1  lead  to 
Corollary  2.3. 

Corollary  2.3: 

Under  the  same  assumptions  as  in  Lemma  2.1,  the  function  h  ^(t;  E) 
has  the  following  properties 

i)  it  is  continuous  for  all  t  €  [0,  V [ E ] ]  and  it  is  strictly  increasing 
for  t  6  [ V[E  H  S*] ,  V[E] ]  ; 

ii)  h  1  ( tn ;  E)  is  convex  for  all  t  £  [0,  V^n[E]]; 

—  1  0 

iii)  h  (t;  E)  <  e* (E)  -yi - — — -  ^  ■  J —  for  all  t  €  [V [E  D  S*] ,  V[E]] 

v  /n[E]  -  v  /n[E  n  S*] 

The  convergence  of  the  ellipsoid  method  follows  from  Theorem  2.4,  the 
proof  of  which  is  a  very  minor  extension  of  the  proofs  given  in  [2,8,11,22,23] 

Theorem  2.4: 

(k) 

Let  { (x  ,  E^)  :  k  =  0,  1,  ...}  be  a  sequence  generated  by  the 
ellipsoid  method  applied  to  a  convex  function  f  defined  on  Rn,  which 
attains  its  finite  minimum  f*  on  a  nonempty  set  S*;  assume  also  that 
3*  H  Eq  is  not  empty,  then: 
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that : 


Min  f(x(J))  <  f*  +  h"1^  V[E_]  (c  )k;  E_)  . 

,  „  ,  i  —  /UnO 

j-0,1, • • • »k 


Furthermore  there  exists  a  subsequence  {k^  :  i  ”  0,  1,  ...}  such 


fCx(ki+l))  <  fC*0^)  , 


(k.) 

lim  f  Cx  1  }  =  f*  , 

i  4-  CO 


unless  finite  termination  occurs. 


i  =  0,  1, 


Proof : 

Let  =  h  1(y  V [ EQ ]  ck;  EQ) .  We  need  to  show  that  f(x^)  f*  + 
for  any  5  >  0,  and  for  all  j  =0,  1,  ....  k  leads  to  a  contradiction. 

j-1 

Define  D.  =  (  fl  H.)  fl  En,  then  D  .  c  E  (1  H  :  clearly  this  is 
J  ^_0  i  ”  1"*"-^  j  j 

true  for  j  =  0;  assume  that  c  H  H._^,  then  fl 

c  (E  ,  fl  H.  ,)  fl  H,  c  E.  fl  H,,  and  the  induction  is  complete. 

J-1  J-1  J  J  J 

Also  f (x^)  _>  f*  +  ek  “  ®  for  all  j  =  0,  1,  ....  k  implies  that 


H.  3  T 
1 


f*+e 


-6 


j+1 


<W-6>  n 

k 


V  j  =  0,  1,  ....  k  . 


Hence 


t  n 

r*+e.  -5 
k 


Eoc 


E3  n“i 


V  j  =  0,  1,  ...»  k  , 
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and  thus 


h(V5;  E0)  -  V1T  0  E  J  <  V[E  d  H^]  -  ±  Hi  ]  c*  , 

k 

or 

ck~5  >  h_1(|  V[EQ]  (cn)k;  EQ)  , 
a  contradiction. 

For  the  second  part  of  the  theorem,  define  a  subsequence 
{k..  :  i  =  0,  1,  ...}  by  induction: 


ko  =  ° 


given  k^,  define  so  that 


(k1+1)  (k  ) 

f(x  1+1  )  <  f(x  1  ) 


and 


(k) 

f(xW)  >  f(x  1  ) 


for  k  -  k±  +  1,  ....  ki+1  -  1; 


(k' ) 

such  a  k^+^  exists  by  the  first  part  of  this  theorem  (unless  f  (x  1  )  =  f*) . 

Q.E.D. 

The  following  theorem  indicates  that  if  V^n[Ep  0  S*]  >  0  (an  unusual 


assumption  for  an  optimization  problem),  finite  convergence  occurs,  and 


,1/n 


1/n 


that  if  V  [Eq  fl  S*]  =  0,  then  convergence  is  geometric  at  a  rate  cn 

2 

(which  is  approximately  1  -  l/2n  )  which  is  independent  of  the  function  f. 
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Theorem  2.5: 


Under  the  assumptions  of  Theorem  2.4,  if  we  let  e*(Eg)  ■  Max(f(x)  f* 


x  €  Eq},  then 


m  <k  V[E  ](c  )k)1/n  _  v1/n[En  n  S*] 

Min  f  (x(j))  <  f*  +  e*(E  )  2  -.g - 2 -  - Q - 

j=0,l,...,k  U  Vi/n[E  ]  -  Vi/n[E  n  S*] 


unless  V[Eg  fl  S*]  >  0,  and 


*  r  v[V  i  i 

k  ^  k  =  I  108  viE~n“s*T  108  “  I  * 

0  n 

in  which  case  Min  f(x^)  =  f*  if  k  _>  k* ;  if  V[E  H  S*]  =  0,  then 
j=0 . k  0 

Min  f(x(j))  <  f*  +  4)1/n  e*(E  )(c  )k/n  . 
it.  4  U  n 


Proof : 

This  theorem  simply  combines  Theorem  2.4  and  Corollary  2.3.  Q.E.D. 

It  should  be  pointed  out  that  the  proof  of  Theorem  2.4  is  a  proof 
based  upon  a  contradiction  given  by  an  inclusion  of  sets  (and  thus  also  the 
volume  of  sets),  but  that  a  number  of  other  characteristics  of  sets  may  be 
used,  provided  they  satisfy  a  concavity  property  like  that  given  in  Lemma  2.1. 
For  instance  the  inradius  function  r(T^+£  fl  Eg)  is  a  concave  function  of 
e,  and  it  would  lead  to  an  alternative  proof  of  theorems  analogous  to 
Theorems  2.4  and  2.5. 

The  key  condition  needed  to  insure  convergence  is  that  Eg  fl  S*  ^  </>. 

This  will  fail  if: 
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ii)  f*  is  finite,  and  S*  -  <t>; 


iii)  f*  ig  finite,  S*  f*  <f>,  and  S*  (1  ■  <t> , 


‘  -iur  t„  CO  o„e  osed  „[U„  8ive.  the  theo_ 

Theorem  2.6; 

If  the  ellipsoid  .echod  1,  applied  to  a  geoer.l  coove,  fuMtlon  , 
e  ined  on  R  ,  and  if  one  does  not  assume  that  E0  0  S*  +  <*,  then 


+  [Max{f (x)  : 


x  f  Eo*  ~  Min<fOO  :  x  (  E  }]  (c  )k/n 

O  n 


3 .  A  specific  convergence  theory 

In  order  to  improve  the  results  of  Section  2,  and  to  show  that  the  rate 
of  convergence  depends  upon  some  characteristics  of  the  function  f,  it  is 
necessary  to  impose  some  conditions  on  the  function  f  which  limit  its 
growth  on  the  whole  of  Rn.  It  is  known  that  every  convex  function  is 
Lipschitz  on  bounded  sets  [16,  pp.  86  and  237]: 

|f(x)  -  f  (y)  I  _<  Ag'ly-x!'  ,  V  x,y  €  E 

where 

A_  =  Sup{  z  :  z  t  ^tf(x),  x  i  E} 

r. 

Def inltion  3. I : 

A  convex  function  f  defined  on  Rn,  which  has  a  nonempty  minimum 
set  S*.  is  defined  to  be  y-Lipschitz  if  there  exists  a  function  y(t) 
defined  for  all  t  )  0,  such  that  y(0)  =  0,  y  is  strictly  increasing 
and  continuous,  and 

f(x)  -  f*  <  y(d(x))  ,  where  d(x)  *  d(x,S*)  . 

Clearly,  every  convex  function  (with  nonempty  minimum  set  S*)  is  y-Lipschitz 
if  v  is  defined  by: 

V (d )  *  Sup{f(x)-f*  :  d(x,S*)  <  d} 
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Two  instances  (among  many  possible  ones)  of  Y  functions  are  given 
below;  they  may  sometimes  be  defined  a  priori  for  convex  functions  belonging 
to  a  given  class. 

Condition  3.2: 


Y(d)  =  Ada  where  a  )  1,  A  >  0  . 

This  condition  is  satisfied  with  a  =  1,  if: 

1)  f  is  piecewise  linear,  with 


A  -  Sup{ liy||  :  y  *  df(x),  x  €  Rn>  ; 
2)  f  is  Lipschitz  on  the  whole  of  Rn,  with 

A  -  Sup{||yil  :  y  €  df(x),  x  €  Rn}  . 


It  is  satisfied  with  a  *>  2,  if: 

2 

1)  f  is  C  and  there  is  an  upper  bound  on  the  largest  eigenvalue 

of  the  Hessian  at  any  point  of  Rn; 

2)  f  is  and  the  gradient  of  f  satisfies  a  Lipschitz  condition 

on  R° : 


I7f  (x)  -  7f  (y) '!  <  y  l!y— x | 


V  x,y  f  R 
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2 

Condition  3.2  is  not  satisfied  for  functions  like  f(x^,  x^)  *  |x^|  +  (x2) 

2  4 

or  (x^)  +  (x,,)  ;  the  next  condition  gives  a  function  y  which  has  a 
different  degree  if  d  is  small,  or  if  d  is  large. 

Condition  3.3: 

al  a2 

y(d)  =  Max (A^d  ,  A2d  )  , 

with  1  _<  <  a2  and  A  ,  A 2  >  0. 

The  condition  that  f  is  Y-Lipschitz  gives  an  estimate  of  c*(Eq) 

=  Max{f(x)-f*  :  x  €  E^},  where  S*  H  t  is  assumed,  which  may  be  used 
in  Theorem  2.5: 

e*(Eg)  =  Max{f(x)-f*  :  x  €  EQ}  <  Max{Y(d(x))  :  x  €  E^} 

=  Y(  Max  d (x) )  <  y(  Max  l|x-y||)  -  y(D(E  ))  . 
x  €  Eq  x,y€E0 

The  theory  of  convergence  of  the  ellipsoid  method  on  Y-Lipschitz 
functions  will  use  the  properties  of  the  functions: 

g(5;  E)  =  V [ (S*  +  SB)  0  E]  , 

and  g(5)  =  V[S*  +  SB]  (defined  if  S*  is  bounded). 

If  one  notices  that  (S*  +  53)  (1  E  -  {x  €  E  :  d(x)  5}  and 
S*  +  Sg  =  {x  €  Rn  :  d(x)  _<  5},  and  that  d  is  a  convex  function  with 
minimum  value  zero,  and  minimum  set  S*,  then  it  follows  that  g(6j  E) 
and  g(5)  satisfy  Lemma  2.1  and  Corollary  2.3. 
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Lemma  3.4: 


Let  f(x)  be  a  y-Lipschitz  convex  function  defined  on  Rn,  and  E 
be  a  compact  convex  set  such  that  E  (1  S*  is  not  empty,  then  the  volume 
functions  h(e;  E)  and  g(6:  E)  satisfy 
i)  h(e ;  E)  >  g(Y_1(t);  E) ,  V  e  >  0; 

ii)  h_1 (t;  E)  <  Y(8_1(t;  E)),  V  t  €  [0,  V[E]]; 
and  if  S*  is  bounded 

iii)  h(e)  >  g(Y_1(e) ) ,  V  e  >  0; 
iv)  h_1(t)  <  Y(g-1(t)),  V  t  >  0. 

Proof : 

Clearly  d(x)  _<  Y  ^(e)  implies 

f (x)-f*  <  Y(d(x))  <  Y(Y_1(e)>  -  e  , 

and  thus  S*  +  y  ^(fc)B  v.  T^A+£.  Taking  the  volumes  of  both  sides,  one 
gets  g(Y  ( ‘- ) )  <_  h(e).  Part  1)  follows  similarly;  and  parts  ii)  and  iv) 
are  classical  properties  of  inverse  functions.  Q.E.D. 

Theorem  3.5: 

Let  f(x)  be  a  ^-Lipschitz  function  defined  on  R°;  under  the  same 
assumptions  as  in  Theorem  2.4,  and  V[Eq  H  S*]  •  0,  the  sequence  generated 
by  the  ellipsoid  method  satisfies: 

Min  f(x()))  <  f*  +  r(D(E.)  (j  <c  >V/n)  ! 

j“0, 1 , . . . k  -  0  2  n 
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if  Y  =  Ad  (with  a  >  1,  A  >  0) 


Min  f(x(j))  <  f*  +  ADa(En)  (c  )V/n  ; 

•  r\  i  1  ~  u  z  n 

al  a2 

if  Y  =  Max(A^d  ,  A£d  )  (with  1  <_  <  02;  A^»  A2  >  0) 


/ .  \  tt ,  1  1  .  /n 

Min  f(xlj;)  <  f*  +  Max  {A .  D  (E.)  (=r  (c  )K)  :  i  =  1,2} 

j=0, 1, . . . ,k  ~  i  0  2  n 


Proof : 


Let  5*(En)  =  Max  d(x);  clearly 
°  x  €  Eq 


g(6  (Eq);  EQ)  =  V[Eq]  and  g(0,  EQ)  =  V[EQ  fl  S*]  . 


Lemma  2.3  gives 


t1/n  -  v1/n[En  n  S*] 

g  i(t;  E  )  <  5*(E  )  -Yj- - =-7—^ - 

"  0  V1' [EQJ  -  v1'  [E  n  S*] 


But  6*(Eq)  D(Eq)  anc*  t^lus 


h-^f,  V  <  T(s'*(t);  Eq)  <  rC»(B„)  .  1/n 


t1/n  -  v1/n[Er.  n  s*] 

-l,.s  -  v  ,  ^  0-  J) 


v  '  [Eq]  -  v"'u[E0  n  S*] 


and  the  theorem  follows  from  Theorem  2.4. 


Q.E. 


If  V [ Eq  H  S*J  ^  o,  then  a  finite  convergence  result  identical  to 
Theorem  2.5  is  of  course  true. 


19 
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If  a  *  1,  this  theorem  gives  the  same  result  as  Theorem  2.5;  but 
a  >  1,  this  theorem  gives  a  rate  of  convergence  of  (c^)^11  which 
a  times  faster  than  the  rate  given  by  Theorem  2.5. 

The  convergence  results  given  above  are  all  based  upon  the  concavity 
h^n  or  g*^n;  this  implied  that 

h(e;  E)  >  [-^  V1/n[E]  +  (1  -  V1/n[E  n  S*]]n 

(and  something  similar  for  g).  The  right  hand  side  is  clearly  a  polynomial 

of  degree  n  in  e,  with  all  of  its  n+1  coefficients  positive  if 

0  <  V[E  fl  S*]  <  V[E] ,  while  if  V[E  D  S*]  =  0  all  coefficients  but  that 

of  6°  are  zero.  Some  sharper  results  exist  for  the  functions 

g,  and  if  the  function  f  is  y-Lipschitz  this  imparts  related  properties 

on  h. 

The  function  g(6)  *  V(S*  +  6B]  has  been  studied  extensively  (if  S*  is  compact 
and  convex) ;  the  key  result  due  to  Steiner  and  Minkowsky  (see  Theorem  4.9) 
is  that  g(6)  is  a  polynomial  of  degree  n  in  5,  with  nonnegative 
coefficients  and  the  coefficients  of  (j  =  0,  1,  ...»  n-s-1,  with 

s  =  dim  S*)  are  all  zero. 

The  function  g(6;  E)  ■  V[(S*  +  5B)  fl  E]  has  not  received  much 
attention,  and  is  much  harder  to  study;  Theorem  4.10  provides  a  bound  on 
g(6;  E)  which  is  a  polynomial,  with  some  negative  coefficients  which 
still  permits  an  improvement  of  the  convergence  theory  given  above. 

The  main  results  given  below  can  be  sunmarized  by  saying  that  the 
rate  of  convergence  of  the  ellipsoid  method,  if  f  is  y-Lipschitz  (and 


if 

is 

of 
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Y  “  Ada)  and  the  dimension  of  S*  D  E  is  s,  is  equal  to  (c  )a^n  8^. 

n 

The  analysis  is  not  done  if  s  *  0  or  s  *  n,  as  it  can  be  seen  that 
no  significant  improvement  on  Theorems  2.5  and  3.5  occurs;  by  this  is 
meant  that  the  rate  of  convergence  would  not  be  improved.  The  only 
exception  would  be  the  unlikely  case  where  dim(s*  fl  Eg)  ■■  0,  and 
dim  S*  >  1. 


Theorem  3.6: 

Let  f  be  a  y-Lipschitz  function  defined  on  Rn;  under  the  same 
assumptions  as  in  Theorem  2.4,  plus  the  fact  that  Eg  fl  S*  is  of  dimension 
s  1,  s  _<  n-1,  the  sequence  generated  by  the  ellipsoid  method  satisfies: 

1)  If  s  =  2,  ....  n-1 


Min  f (x 

j=0,l,. . . ,k 


(j) 


)  <  f*  +  rCr 


(n-s+1)  V[En] 


2 co  V  [E_ 

n-s  s  0 


- _  ,c  \k.  1/ (n-s) 

n  S*]  <  n;  J 


D 


and  if  y  =  Ad 


Min 

j=0,l,. . 


f(x(j))  <  f*  + 


{■ 


(n-s+1)  V[Eq]  -ja/n-s 

n  S*]J 


2 co  V  [E_ 

n-s  s  0 


(ca/ (n-s) ^k 


provided  that  k  is  large  enough: 


7V'V 


co  v  [E_  n  s*] 
n-s  s  0 _ _ 

n-s+1 


r 

n-s 

n-s+1 


V^E0  0  S*]  r(En)-,n-s 


rD(Eo\s 

S“sl-2— ■ > 


VT 


t 

i 
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v  [e  n  s*] 
S'6’  V  i  Vs  -V.— 


n-s 

6 


for  all  6  f  [0,  5(Eq) ]  where 


and 


5<V 


n~s 

n-s+l 


VE0 


SO) 

s 


n  S*]  r(E0) 

_D(E  )  s 
/  ^  \ 


-1 

g 


(t;  EQ)  < 


I  03 

L  n-s 


(n-s+l)t  ~|l /  (n-s) 

»s[e0  n  s*]j 


for  all  t  £  [0,  t*(Eg)]  where 


t*(En)  =  w 
0  n-s 


VEo 1  s*i 

n-s+1 


6(E0)) 


n-s 


The  theorem  follows  from  Lemma  3. A  and  Theorem  2. A. 


Q.E.D. 


The  next  convergence  results  are  based  upon  the  Steiner  polynomial 
g(<5)  (see  Section  A).  The  order  to  use  g(5)  is  the  study  of  the 
convergence  of  the  ellipsoid  method  one  must  assume  that  s*  is  compact 
and  that  contains  entirely  some  level  sets  of  f:  define 

&0  =  Sup {g  :  Tf*+r  c  Eq}  «*  Inf {f (x)-f*  :  x  t  EQ}  . 

If  f  is  y-Lipschitz  then 
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s*  +  r  (e )  B  <-  Er 


V  &  f  [0,  tQ) 


g(6;  E  )  =  g (6)  =  l  (")  W  [S*]  61  V  5  €  [0,  y~L(e  )]  • 

i=0 

1  k. 

If  V[S*J  <  —  V[Eq]  (c  )  ,  define  6(k)  to  be  the  unique  positive  zero  of 


J0  0  Vs*]  6  -  2  V[E0J  (cn} 


then  Hin  f(x^)  f*  +  y(5(k))  provided  that  6(k)  £  y  ^(e.). 
j=0,...,k 

1  k 

If  V[S*]  2  ~2  v[2q1  (cn)  *  tlien  there  are  no  positive  zeros,  implying 
that  finite  convergence  has  occurred. 

Clearly,  as  g(6)  is  a  polynomial  with  nonnegative  coefficients,  one 


6(k)  < 


/ V [ Eq]  (cn)K  \  1/ (n-i) 

\ 2  (J)  Wi[S*]  / 


if  i  ^  n-s,  ....  n  and  i  ^  0,  where  s  =  dim  S*. 


Theorem  3.7. 

Let  f  be  a  y-Lipschitz  function  defined  on  Rn;  under  the  same 
assumptions  as  in  Theorem  2. A  plus  the  facts  that  S*  is  compact,  and 
that  Sq  =  Inf{f(x)-f*  :  x  f  Eq}  is  positive,  then  the  sequence  generated 
by  the  ellipsoid  method  satisfies: 


>4  4 


Min  f (x 


m  /i-vfEj  (c  r-,i/(n-i)\ 

(j))  <  f*  +  Min  y( - - - ~\ 

n-s  <  i  <  n  \  *-2(")  W,[S*H  / 

i  +  0  11 


j— 0  >1 , • • • ,k 

where  s  =  dim  S*,  provided  that 


/|-V[E  J  (c  )  -.l/(n-i)  \ 

Min  y(  - 2 - —\  <  ; 

n-s  <  i  <  n  \  1-2  (?)  WJS*]-*  '  0 


i  *  0 


vi'  i 


if  in  addition  y  =  Ad  and  s  <  n-1,  then: 


V[E_]  -ja/  (n-s) 


(i)  r  vlv  T 

Min  f(x^>)  <  f*  +  A|^ - v”Ts*tJ 

j=0,l,...,k  >-  n-s  s  -J 


^ca/(n-s)^k 


provided  that 


rV[EQ]  (cn)  -ja/ (n-s) 

A  2w  V  [S*]J  -  £( 

L  n-s  s  J 


Thus  every  nonzero  coefficient  of  the  Steiner  polynomial  gives  a  bound 
on  the  convergence  of  the  ellipsoid  method;  for  instance  if  y  =  Ada: 


V[En]  (c  )  -ia/ (n-s+1) 


mn  £(xd),  <  f.  +  {-  °  f  TsmJ 

j=0,l,...,k  n-s+1  s  -* 


,  if  s  >  2  ; 


or 


V[En]  (c  )  -,a/n 


Min  f(x(j))  <  t*  +A  - ^ - - — 

J-0.1 . k  -  L  2“n  J 


if  s  =  n 


provided  that  k  is  large  enough. 
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1 


It  might  be  worth  pointing  out  that  every  result  in  this  paper  (except 

for  Theorem  3.6)  is  valid  for  Levin's  method  of  centers  cf  gravity,  if  c 

is  replaced  by  c  . 

n 


i 
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4.  Volumes  of  convex  arrays 
Definition  4.1: 

A  mapping  Tu  from  a  convex  subset  U  of  a  linear  space  onto  the 
class  of  convex  subsets  of  is  called  a  concave  array  if 


u^  u2  €  U  U  [0,1] 

implies 


Xu1+(1-X)u2 


3  XT  +  (1-X)  T 


it  is  a  convex  array  if  the  inclusion  is  reversed,  and  a  linear  array 
if  equality  holds. 

Clearly  a  linear  array  is  both  convex  and  concave. 


Lemma  4.2; 

Let  A  and  A^,  i  =  1,  ...,  r,  be  convex  subsets  of  Rn,  and  E  be 

a  convex  subset  of  Rn,  then 
r  r 

(I  v  )A  =  £  v  A  if  v  =  (v  ,  ...»  v  )  €  R*  (or  v  €  -R*) . 

i=l  1  i=l  1  1  r 


r  r  r 

2)  1  v  (A  fl  E)  c  (  l  v  A  )  0  E  if  l  v  =  1  and  v  €  R^. 

i=l  11  i=l  i=l  X 

r 

3)  ^  v.A,  is  a  convex  array  for  v  €  R;  it  is  a  linear  array  if 
i=l  1  1 

r  r  r 
v  €  R+  (or  any  of  the  2  orthants  of  R  ). 


Lentna  4.3: 

Let  T  be  a  concave  (or  linear)  array  defined  on  a  convex  set  U, 
u 

and  E  be  a  convex  subset  of  Rn,  then  T  HE  is  a  concave  array  on  U. 

u 
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Lemma  4.4: 


Let  f  be  a  convex  function  defined  on  Rn,  then  T  =  {x  (  Rn  :  f(x)  < 

a  — 

is  a  concave  array  for  a  (  R;  and  if  E  is  a  convex  set  T  f)  E  is  also 

a 

a  concave  array. 


Lemma  4,5: 

Let  E  and  A^,  i  *  1,  ....  r  be  convex  subsets  of  Rn,  then 
r 

(I  v.A  )  fl  E  is  a  concave  array  on  v  =  (v.  ,  . . . ,  v  )  (  Rr  (or  any  of 
i=l  1  r  + 

the  2  orthants  of  R  ). 


Theorem  4.6; 

Let  f  be  a  convex  function  defined  on  Rn,  E  a  compact  convex 
subset  of  Rn,  Tq  =  {x  €  Rn  :  f(x)  a},  and  a*  =  Min{f(x)  :  x  (  11} ; 
then  fl  E  is  continuous  in  a  for  a  (  [a*,°°). 

Proof : 

As  f  is  continous,  T^  fl  E  is  convex,  compact  and  nonempty  for  all 
a  _>  a*  (and  empty  for  a  <  a*). 

First  we  show  that  for  all  a  >  a* 

lim  T  fl  E  =  T  (1  E  ;  i.e.,  for  each  6  >  0 

T,  +  0  ^ 

there  exists  an  t)  >  0  such  that  for  all  r|  (  (0,r]]  ,  (T^  fl  E)  +  5B^ 

^  H  E  and  (T  D  E)  +  5b  ’  Ta.  The  first  inclusion  follows  from 
Ta+|^  TQ  for  t]  _>  0.  The  second  inclusion  is  not  true  if  and  only  if 
=  ((T^dE)  +  6B^)C  fl  (T^  H  E)  is  not  empty  for  all  r)  >  0  (AC  denotes 
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the  complement  of  A  in  R  ).  The  sets  for  rj  >  0  form  a  nested 

sequence  of  compact  sets,  and  thus  there  exists  an  x  €  Rn  such  that 

x  i  K^,  q  >  0  (unless  some  as  empty).  Such  an  x  belongs  to 

THE  lor  all  r|  >  0,  and  thus  x  €  E  and  x  €  T  ;  also  x  (  (T  fl  E)  +  5B^)C, 
a+r)  a  a 

and  thus  x  (  n  E,  a  contradiction,  concluding  the  first  part  of  this 
proof.  Note  that  no  convexity  assumptions  are  needed  for  E  or  f. 

For  the  second  part  (i.e.,  lim  T  d  E  «  T  (1  E  for  a  >  a* 

n  +  o 

and  r)  a-a *)  one  needs  to  show  that  for  every  5  >  0,  there  exists  an 

n  >  0  (n  <  a-a*)  such  that  (T  0  E)  +  6B^  ~>  T  HE  and 
1  —  a  a-r) 

(Tq  fl  E)  +  5B^  3  Tq  fl  E  for  all  r|  €  (0,r)]  .  The  first  inclusion  is 
trivial;  if  the  second  is  not  true,  then,  following  the  reasoning  used 
above,  there  exists  an  x  £  Rn  such  that 


x  €  ( (T  fl  E) 
a-T) 


+  6B0)C  n  (Ta  n  E)  for  C  (0,r|)  ; 


i.e. ,  x  €  Ta  fl  E,  x  t  (T  fl  E)  +  5B  for  r]  €  (O.ri] . 

Choose  x  £  T  ~  fl  E;  it  follows  from  the  convexity  of  E  and  f 
a-T]  J 

that  Xx  +  (l-X)x  €  d  E  if  X  €  [0,1];  take  X  such  that 

0  <  X  <  6 /Ijx-xlt,  then  x*  =  Xx  +  (l-X)x  satisfies: 


|x*— x |!  <  5  and  x*  (  T  (1  E  . 
1  1  a-Xr| 


Thus  x  =  x*  +  (x-x*)  €  (T^  fl  E)  +  6B  ,  a  contradiction.  Q.E.D. 
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Theorem  4.  7  (.the  Brunn-Minkowski  Inequality): 

Let  £  U  (where  U  is  a  convex  set)  be  a  concave  array  of  compact 

convex  subsets  of  Rn ,  then  V^n[T  ]  is  a  concave  function  of  u. 

u 


Proof:  [3],  p.  88.  [5),  p.  97,  [9],  pp.  159  and  187. 


Theorem  4.8: 

Let  A^,  i  =  1,  ...,  r,  be  r  compact  convex  subsets  of  Rn,  and 
v^,  i  =  1,  ....  r  be  r  nonnegative  numbers,  then  the  volume  of 

r»  £  t"i 

>  v.A  is  an  homogeneous  n  degree  polynomial  in  the  variables 
i=l  1  1 

v  ••••  V 


Vt  l  v  A  ]  =  l  j 

_  1  1  s  _  1  J  _ 


i=l 


V1  V1 


I  V[A  ,  A  ,  ...,  A  ]  v  v  •••  v 

1  =1  X1  X2  n  11  X2  r 

r 


where  the  coefficients  V[A  ,  A.  ,  ....  A.  ]  are  chosen  to  be  invariant 

1  X2  Xn 

under  permutations  of  the  arguments,  and  are  called  the  mixed  volumes  of 
the  linear  array.  The  mixed  volumes  are  nonnegative,  and  continuous  and 
increasing  functions  of  their  arguments. 


Proof :  [3],  p.  40;  [5],  p.  85. 


Of  particular  use  will  be  the  linear  array  of  parallel  sets  A-H5B, 

5  0,  with  A  a  compact  convex  set,  and  B  the  closed  unit  ball  in  Rn. 

The  mixed  volume  V[A,  . . . ,  A,  B,  . . . ,  B]  is  called  the  k^  transversal 

n-k  k 


30 


mass  integral  and  denoted  as  W^[Aj .  It  follows  immediately  from  Theorem  4.B, 


V[A+6B]  =  l  (?)  W  [A] 
k=0  *  * 


is  a  n  degree  polynomial  in  6  with  positive  coefficients.  It  can 

be  shown  that  W^[A]  =  V(A1 »  nW^[A]  =  F[A]  the  surface  of  A,  and 

W  [A]  =  to  . 
n  n 

Also  [W,  [T  ]]^^n  ^  is  a  concave  function  of  u,  if  T  ,  u  f  U  is 
k  u  u 

a  concave  array  [1,  6,  7J. 

If  A  is  a  s  dimensional  compact  convex  set  on  Rn  then  the 
following  theorem  characterizes  V(A+6Bj . 


Theorem  4.9: 

Let  A  be  a  s  dimensional  compact  convex  subset  of  Rn,  and  let 
W^[A] ,  k  ■  0,  1,  ....  s  be  the  transversal  mass  integrals  of  A  seen  as 
a  subset  of  a  s  dimensional  space,  then: 


V[A+6BJ  ,  j  <  =  )  »  |*J  6k  , 

k=n-s  k-n+s 


the  coefficients  of  6°  S,  6n  S+^  and  5n  are  respectively  co^_s Vs [ A ] 

4  co  ,,  F  (A)  and  to  . 

2  n-s+1  s  n 


I’i  vKit  : 


Proof  : 

Assume,  without  restriction,  that  E  has  its  center  at  the  origin 
of  coordinates. 
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Define  A  “  A  H  (1  - 
for  5  i  lO.nl-  Thus 


IU)E  for  n  €  [0,  r (E) ] ;  clearly  A^+SB  c  E 


VI  (A  +6B)  n  El  =  VIA  +6B1  >  Vs  VV  ^  V  °  1  51  ^  1  ^ 


(using  Theorem  4.9).  Now 


Vs(A  "I  E]  -  Vg[Ari]  =  Vg[A  fl  (E/(l  -  r(£))  El 

<  Vs[M(A)  P  (E/(l  -  Tjgy)  El  lf1(  l°*  r(E)!> 

where  M (A)  denotes  the  s-dimensional  affine  manifold  containing  A. 

and  /  denotes  the  set  difference  (S^  *  <x  f  S!  :  x  *  S2})’ 

Define  a  linear  map  T  such  that  T(E>  -  B,  and  let  L(A)  =  M(A)  -  A 
the  s-dimensional  linear  subspace  parallel  to  M(A),  then: 


V 

s 


[M(A)  'I  (E/(l  -  yyjy)  E)1 


V^L-^ -  ---  V  (T(M(A)  n  (E/(l  -  r^y)  e)  ) ) 

V  [T(LCA)  n  E)1  sl  r'L) 


v  [M(x  (A) )  n  (B/(l  -  ^y>  b)  1 


<  (^|V  vg[M(T(A))  n  (B/(1  -  T^y)  b)  1 


where  r|  c  1 0 ,  r (E)  1  . 


be 
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Now  let  £  =  <J  ( 0.  M(T(A))),  where  clearly  t  f  [0,1]  as  A  H 


is  not  empty;  then 


Vg[M(T  (A)  )  /  <B/()  -  r(-")  )  B 1 


2  s/2  •  s  t  2  s/2'1 

(1-t  ^  -  (l  -  —)*  (1  -  v'  j 


1 


l  E ) 


if  0  <  t  '  1  -  > r  1  h 


.  U-t'V72 

s 


if  1  -  ■  / r  1  f.  >  <  t 


The  maximum  of  this  as  a  function  of  t  is  attained  for  t  *  0  it 
s  >  2,  and  for  t  =  1  -  •  /r(E)  if  s  =  1  or  2  (note:  if  s  -  2  then 
it  is  constant  for  t  *■  [0,  1  -  •  /r(f\)i).  Thus 


V  [  M  (T  ( A )  )  ( B  /  ( 1  -  B)  ] 

s  r  (F. ) 


It  follows  that 


V  [Aj  <  V  [A  n  E] 
s  o  —  s 


if  s  >  2 


if  s  *  1  , 


and  the  theorem  follows.  Q.E.D. 

If  s  =  dim  (A  f!  E)  *  0,  and  A  reduces  to  a  point  in  the  interior 

of  E,  then  V[(A+5B)  HE]  =  jo  5n  for  6  small  enough;  if  s  =  dim(A  fl  E)  =  0, 

n 

then  A  itself  may  be  of  any  dimension,  and  a  slightly  different  approach 
would  be  required. 
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